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I . Introduction 

A classical univariate mixed model analysis of a spl It-plot doiign as 
discussed for example by jSelsser and Greenhouse (1958), Gr^nhausie and Gels- 

serMI959), Kirk (1968, p. 250), Myers (1966, p. 223) and WMer (1971, p, . 

250), among others. Is familiar to most experimenters, the classical mixed 
linear model for the design Is . 

where. 



y Is an arbitrary cons tani, 

^1 



Ot Is the effect of the .1^*^ treatment group which Is constant for 



all subjects within treatment group f. 

Is the effect of the k^^ profile Condition for all subjects, 
(a8)jj^ Is the Interaction effect of Oj and gj^, 

Sjjjj Is the component associated with subject J, nested within aj, 
. and 

^(l)lk error component for subject J within treatment group I 



for the k^^ prof I le condition. 



In addition, the random components Sjjjj and are assumed to b^ 

Jointly Independent and nonnally distributed: 

^(l)J ^^^^ 



O ^Paper presented at the annual m^etlna of the.Amerlcan Educational Research 
ERXOocfatlon, Chlpaqo, IMfnofs, AprM 1974.., / . 



2 ■ . .; 

e(,jj^ -v. IN(0, (l-p)fT2) \ 

Thus, the vartance-covar lance matrix I has the form 

s e 

where J Is a matrix of unities and I Is an Identity matrix so that E satisfies 
the compound symmetry assumption. Although the compound symmetry assumption • 
Is only a sufficient condition for exact unl var late F- ties ts and not a neces- 
sary condition, %s bhovfn by Huynh and Feldt (1970), to analyze splft-plot de- 
signs. It Is the one most often assumed,, by researchers. When E fs not of the 
approproprlate form for a univariate mixed model analysts, a multivariate 

. ' ■ V ■ ' ■ 

analysis of the data Is most appropriate. Koch ""t 1969) reviewed the parametric 
and nonparametric multivariate analysis procedures one should use to analyze- 
the split-plot design given In (I) using the classical mciltl var late linear 
model for arbitrary E under normality and nonnormal Ity • More recently, Tl mm 
and Carlson (1973) demonstrated, fol lowing Bock (1963a, 1963b), the corres- 
pondence between univariate and numerous multivariate tests employing a mutti- 
varlate ful I rank linear model* In this paper we extend the work of TImm and 
Carlson (1973) to split-split plot designs and also show how the growth curve 
model Introduced by Potthoff and Roy (1964) aad studied by Khatrl (1966), Rao 
{''1965, 1966, 1967), Grizzle and Allen (1969) and Kletnbaum (1973a), among 
others, may be used 'to analyze split-plot and spltt-spllt plot designs with 
multivariate repeated measures. 

2. Analyzing Split-Plot Designs 

Before discussing splft-spllt plot designs. It ?s convenient to Intro- 
duce some notation Involving the analysis of sp I It-plot, designs and to review 
the correspondence between a univariate and multivariate analysis of these 



3 

designs. The adaptation of the ^agrlcul tura I split-plot deslqn to the behavi- 
oral sciences may be separated Into two categories; split-plot profile anal- 
ysts repeated measures designs and split-plot trend analysis repeated mea- 
sures designs. Using FIg(jre I to make the distinction between the two types 
of spllt-[Jlot repeated measures designs, we say that we have a profile analy- 
sis If the levels of B are not ordered and. a trend analysis If the levels of 
B are ordered. The sj In Figure I Indicate that subjects are measured re- 
peatedly over all levels of factor B, but that the subjects within each level 
of A are different. 



B (Condl+lons) 



(groups) 




I 



^ Figure I, Split-Plot Repeated Measures Design 

Stnce Tlmm and Carlson (1973) only considered the correspondence be- 
tween univariate and multivariate analysis of 'repeated measures profile data, 
we shall briefly review the correspondence between univariate and multivari- 
ate analysis of both types of data. For tfji'is purpose, the data given In 
Table I, from Kirk (1968, p. 274), are reanalyzed. The- univariate profile 

and trend analysis of the data are displayed In Table ^ and Table 3, respec- 

>. ■ ■ • " 

tlvely. For either ' ana lysis the scores associated with factor B are assumed 

to be commensurable, expressed In the same units. 
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Table I. Ktrk's Data 
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Table 2, Univariate Prof I le Analysis 



Hypotheses 




DF 


MS 


F 


P'-va 1 ue 


1. 


Constant 


924.50 


1 


924.50 




= 592.63 


< .0001 


2. 


A 


3.13 


1 


3.13 


'1' 


= 2.00 


0.2070 


3. 


S(A) ^ 


„ 9.38 


. 6 


1.56 




c 




^4 — 
















4. 


8 „ 


.194.50 


. 3 


64.83 


,<!' 


= J27.8Q, 


'0001 


5. 


AB 


19.38 


3 


6.46 


■4' 


= 12.74 


0.000 1 


6. 


Error 


9.13 


18 


0.5; 






— ^ 


















7. 


Total 


1 160.00 


32 











/ 

/ 

/ 
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Table 3. univariate Trend Analysis 






nypoTneses 


SS 


/OF 


•MS 


F 


p-va 1 u6 


1. 


Constant 


924.50 




1 




924.50 


1 

(j) " 592.63 


<.000l 


2. 


A 


3. 13 




I' 






(|) = 2.00 


0.2070 


3. 


S(A) 


. 9.38 




6 










4. 


B 


194.50 




3 




54. o3 








1 f nflar* +rAnHI 


184.90 




1 


134.90 


(-4-) = 182.71 


< . 000 1 


6. 


Quadratic trend 




8.00 




1 


8.00 


< 

(7^)^= 25.64 
14 • * 


0.00. 


1. 


Cubic trend 




1 .60 




1 
1 


1 .60 


(j^) = 8.16 


0.0289 


9. 


AB 


19.38 




3 




Ac 

D. 46 






Q 






13.23 




1 


1 3.23 


(_^) = 13.07 


0.01 12 


10. 


Quadratic trend 




3.13 




1 


3.13 


(jj) - 10.02 


0.0195 


II. 


Cubic trend 




3.03 




1 


3.03 


(— ) = 15.43 


0.0077 


12. 


Error 


9.13 




18 




0.51 






15- 


Linear trend ' 




6.08 




6 


I.OI 






14. 


Quadratic trend 




1 .88 




6 


0.31 






15. 


Cubic trend' 




Ul8 


5. 


6 


.20 




c. 


16. 


Tota' 


1160.00 


32 









Using the restricted full rank linear nvodeU as developed by Tlrnm and 
Carlson (1973, 1974a, 1974b) to represent the classical split-plot repeated mea- 
sures design, (t), the restricted full rank linear moQol for the design Is 
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(2) - y,j^ = e^jjj^ ■ " . " 

f = U ...» I; J=l, Nj; k=l, ...» p - 

. subject to i:(N,-l)(p-l ) = (N-I)(p-I) linearly Independent^ 
f 

restrfcttons 

where I Is^the treatment group fndex, J Is the subject Index, with subjects 
nested within grotrps, and k Is the repeated measures Index over p profi le con 
ditlons. For a trend analysis the restrictions In (2) are modified. Table 6, 
The hypotheses being tested In ANOVA Tabte 2 are shown In Table 4. The popu- 
lation means associated with Klrk^s data are given In Table 5 where the fami- 
liar dot notation Is used to represent averages. 

Table 4. Univariate Profile Analysis Hypotheses 



Source 


Hypotheses 


DF 


Constant 


• • • 


= 0 


1 


A 


al 1, 


's are equal 


I-l 


S(A) 


""11. 


= "12. = " "IN, 


/ . 




• 
• 


• . » • • • 

' • • • • 






"II. 


= "12. = 'y{w. 




a 


al 1 


/ 

y^^j^'s are e^ual 

/ . 


,P-1 


AB 


" "l.k 


■"i'.k-"K.i^'''"i'..k'' = ° 


(I-I){p-I) 


Error 


^IJk 


■"lj'k-"!jk'-'"lj'k'' ' ° 


(N-f)(p-ir 


Total 




Np " 



Table 5. P^ulatlon Parameters for Kirk's Data 







^2 


83J . 


^4 


(Means) 








^(\2 ' 


"113 


"114 


• "1 \\ 

t 




^? ■ 


, ^'121* 




"123 


"124 


"12. 




^3 


'y 1 1 


1 






« 






W|4| 




.-"143 


"144 


> 

"|4>^ 


(Means) 




^1.2 


"1.3 


"1.4^ 


W,.. 




s' 
s, 


^211 


V212 


"213 


"214 


"2|. 






^221 


^222 


"223 


"224 


"22. 




s' 

^3 


^231 


^232 


"233 


"254 


"23. 




s' 


^241 


"242 


"243 


"244 


"24. 




c 


V2.I 


"2.2 . 


"2.3 


"2i4 


"2-. 




(Means ) 


















V..2 


"..3 


"..4 





V 



Using the means !n Table 5, the hypotheses, tested In Table 3 are 
summarized In Table 6; those sources not shown In Table 6 are Identical to 
the expressions given In Table 4, 



Source 



^ Table 6. Univariate Trend ftna'lyS'I's Hypotheses - 

Hypotheses'/' 



Linear trend 
Quadratic trend 
Cubic trend 



AB 



Linear trend 
Quadratic trend 
Cubic trend 



Error ' 
^ Linear 

(Restrictions) 



Quadratic 
(Restrictions) 



Cub I c 

(Restrictions) 



■3ii .-u o+u 7*^\i,.^°^ 



.+3 



■'^1- I"^ |'2'^I-3*^|.4'*"'^2.|'^^2.2"^2.3''^'*2. 



^1* r^|-2"^ l-3'^l-4">'2..t*^2.2'^^*2*3"^2.4 ' 
1- 1*'" 1-2"^ I -3*** 1 .4'*"V2, i"'v2./'v2.3"W2. 



= 0 
= 0 

» 6 



-3y , , , -y , , 2+11 , , 3^-3y , , 4^3y , 2 , +P , 22"^ 1 23"'^ 124 = ° ' 

1 2 1 1 22*'^ 1 23*^ 1 24''5^ f 3 1""^ 1 32"'^ 1 33-'»' 1 34 r ° 
-3w,3,-y,32+y,33+3y,34+3y,4,+y,42-l^,43-3y,44'= 0 

-'^2||-V2l2*"2l3''^2|4*^'^221*^222-^223"^''224 = ° 
-3p22,-V222''»^223'-^224*'^23l^"232-'^233-5^234 " ° 
-3y23i-V232"^233*^234'''^24>"'^242-^243-'^244 ' ° 

^ir^U2-^l3*^r4-^2l*^l-22*^23-^l24 = ° 
^ 1 2 r ^22- ^ 1 23*^ 1 24-^^ 1 3 1*** 1 32*^^ 1 33"^ 1 3?l " ° 
^|3r^I32-^33^^34-'^l4!*^42^»'l43-^44 = ° 
^21 r^2(2-^2l3^^214-^22l^%^V3-'^224 = ° . 
^22rW'223^"224-"23l^^23?^.y233-^234 = ° 
^23r^232-W^234-»^24l^'^242tV3-^244 ° 

- ^||*5^l2-'^l3*»'ll4^"l2r'^I2i?*'''l23-»'l24 = ° 

- "l2l*'^22-5"l23^''l24t^l3!-^^32*^^33-»'l34 = ° 

- ^|3I*^^32-'''|33^^I34*^4|-'^I42*^'^I43-^I44 = ° 



- "21 |+3l'2l2-'^243*^2l4-*-^22r'"222*5»223-^224 

-^22l*^"222-'V3*"224^"23r'^ 

- u 



'b2*'^233-''234 



« 0 
= 0 



23 r5'^232-5^233*'^234^'^24 r'^242^5*'2'43-^244 = ° 



DF 
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Following TIrnm dhd Carlson (I974a7 I974b)^ (2) Is written as follows: 

— . - - .. . * . . . 

, y « W y + c n 

<^ ;^ ' V • ^ X ! N.x p p X I N X I 

(3) ' sut>}ect to a set of restrictions 

. * s x p p X i "^S X I 

' ■ . -" . .... 

The form of the hypotheses vln Tables 4 and 6 Is 



(4) * >1: . C / u — 0 

The hypothesis sum of ^uares, SS^^, for each hypothesis has the cjeneral form 

(5) ' SSj^ = (C»^)'(C»(FD"'.F')Cr^'(C'igj) 

where ' - ^ 

(6) . Irtj = (I-D"'R(R'D"'R)''R')Ji^ ^ 7 

- A . . ■ - V- ■ 

D "a WW and = (W'Wl - W,'y » D W*y: The^sum;of scjfUares for error, under a 

fixed effect model. Is 

(7) ^ ^s^" ^rV'^x-^' 

The degrees of •freedom associated with any SS^ Is v^, the full row rank of C, 

and the degrees of freedom for SS Is v « N-p+s where N^Is the total number 

e . e ■ ■ ^ 

of observations, p Is the full column rank of W, and s Is the full row rank of 

R*-^ ' ... , . 

If ^e varlance-covarlance matrix E for the data In Table I Is not of 

the proper form for a univariate analysis, the correct analysis of the data 

Is a multivariate analysis. The Advantage of the multivariate analysis over 

the univariate analysis Is tKg:t the analysis Is valid whether or not £ satls->' 

- , • * ■ ' * • 

fles the compound symmetry assumption. In addition, univariate tests are 



easi ly obtained from some multivariate tests*. To analyze split-plot repeated 

nfieasures data using a multivariate model we again must have commensurable 

units over conditions^ factor B; furthermore, the number of subjects within 

ead> level of A must be greater than or equal to the number of times tJje sub- 

Jects are observed over the repeated measures facitor. 

The restricted full rank multivariate linear modal Is V 

frV Y W U + 

. . Yl X p N >^ q q X p N X p 

,(8) subject to the restrictions 

.R^ U « 0 
rxq q x p r x p 

where Y Is a data matrix, wNs a known full column rank design matrix, U Is 
an unknown parameter matrix of population means, and Is the random error 
matrix. The matrix of full row rank r Is. the restriction matrix. Removing 
the restrictions from ('8)., the unrestricted multivariate Ifnear model Is rep- 

— — resented-JxyL _ ' ' 

(■■ ■ . ■ . ■ ■ ■■ - 

(9J ^ • SI: Y «.WU + E - . ' 

• ' " _. ■ . ' * ■ o ■ 

In §|ther case, we assume that each row veptor In Y follows a multivariate nor- 

.... ■ . 7 - o . ' ^ 

ma! distribution and that ^ 

• ■ ' E(y) » wu \ ^ , 

(10) . V 

V(Y) « 1^8 E 

■ . . . V '.- ■ . ■ ' • . 

To"1fest hypotheses of the^.f orm . ' 

(11) ' ^ H: C»UA = 0 

under 2i, where C*(v^ H q) Is a. known matrix of real nufrfcers of rank Vf^ <, q and 
A(p :jc t) Is a known real matrix of rank t < p, hypotheses and error sum of 

sqiial-es and products matrices of the form ' ^ 

■ • ■ • ■■ • . < 



i I 



U2) 



« (C'uJjA)'(C'(FO 'F')C) '(C'UJjA) 

S« " A»(SS^)A 
© e 



are constructed where 

SS_ » (Y-WU2{)'(Y-WUiij) 



Lfe = (I-D"'R(R'Or'R)HR'>U« 
(13) " . ^ \ " 

U„ = (W'W)'''w'Y = D''w'Y „ 

' ^. " : , . . V ^ - ■ • ' 

^Letting s * min (t, v^), muJtlvarlate hypothes(Ss of the form given In (II) are 
directly tested using several multivariate criteria which are fiincHons of the 
roots X|, and Xg of the determlnantal equation 

(J4) V. |S»,-XS 1=0 

- n e ' 

■ V ' ■ ■ ■ ■ 

A brief review of several multivariate criteria Is contained^ In TImm and Carlson 
(I9l3). For the purposes of this paper, w'^-shall use only Wl Iks' A-crlterlon 

■ ■* " . i.s4.--'.-^---;- ' , ■ 

;(I5) A « ® = n (l+X )'' 

IS^+S^I 1=1 V ' 

The multivariate hypothesis Is rejected If 
(16) A < if (t, v^, v^) 

where V « N*q+r Is the degrees of freedom .for error. A general discussion of 
multivariate criteria as wel I as the construction of simultaneous confidence * 
bounds for functions of the form \i> = c'Ua of the elements of U are discussed 
In TImm (1974). A general approach for Investigating arbitrary functions of 
the elements of U, using a multivariate simultaneous test procedure, has been 
developed by Mudholkar, Davidson and Subbal^ah CI973). Percentage points for . 
the general U-dlstrlbutlon have been tabled by Wall (1967). 
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To test hypotheses undar ^ or n, given a parameter matrix U of means, 
we merely have to construct matrlce-^ C and A to represent the hypotheses. 
The general form of U for a. multivariate analysts of a spl ft-p lot design Is 



(17) 



U 

I X p 



'II 



'21 



'12 
'22 



I »'12 



'ip 
'2p 



»^IpJ 



To analyze a splft-plot design using the multfvarfate mbdel, the unre 
strlcted full rank multivariate model Is empfoyed. Multivariate tests of A, 
B, and AB, differences between groups, differences arrong profile conditions, 
and the Interaction between groups and profile conditions, respectively, are 
represented by 



A*: 



(IB) 



B*: 



^11 






-. 


''II 


• 




"22- 

• 


S • • • 8 


%2 

• 


• 

^^'Ip . 




• 




• 

I ^Ip . 


' ^11 




'^12" 




f "\ 

^IP 


■ 


m 


m 




^2p 

• 


• 




• 

> ^12 


- 





(AB)»: 



V 1 1-^2 
^12-^3 



^■(p-l)-^lp 



»'2r^22 
''22-»'23 



^ "2(p.|)"^2p 



■ 73 • • • S 



1^11-^12 
''l2-''!3 



^^I(p-l)-^Ip 
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when prof I le data are analyzed. As shown by Tlmm and Carlson (1973), only 
the univariate test of AB can be recovered from the multivariate test (AB)*, 
provided the post matrix A, when stating the hypothesis In the form C'UA = 0, 
Is appropriately normalized. This Is not the case for the tests of A* and B*. 
The univariate tests of A and B cannot be recovered from the tests of A* and 
B*, Alternatively, If the test (AS)* Is not significant or If we Ignore the 
possibility of an Interaction between A and B (groups and conditions), the 
tests of A and B are written as - ' 



p 


P 


P 




A: jr y, ,/p = 
J=l 'J 


J=l 


= E 
J= 


yij/p 


I 


I 


1 




B: E y,,/I = 
1=1 " 


E y.^/I = 
1=1 


= E 
1 = 


1 



If there are an equal number of subjects In each group. From these statements 
of A and B, the univariate tests of A and B are Immediately obtained provided 
the pbsTra the hypothesis, C'UA = 0, Is appropriately normalized. 

That Is, A must be normalized so that A'A « I. Several other multivariate 
tests are also testable using the multivariate representation for equal and 
unequal numbers' ojf subjects within each level of A; however, these are dis- 
cussed In detail by Tlmm and Car Ison ( 1973) and will not be considered here. 

To Illustrate how we would test A*, and (AB)*, Kirk's data are re- 
analyzed. For Kirk's data, 

h\\ ^12 ^13 ^14 ' 
^ ^21 ^22 ^23 ^24 . 
To test A*, the matrices « 

« (I -I) and A = I2 

. are selected. To test B*, the matrices 



4 



r I 0 0 ) 

-I I 0 

0 -1 : 

0 0 -1 



are used. Finally/ (AB)* may be tested by using 



I ) and A = 



I 0 0 



0 0 



The MANOVA table for the analysis Is shown In Table 7. 
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Table 7. Multl vgrlate Profile Analysis I 



Hypotheses 


MSP ^ SSP/v 


OF 




yf VC3 1 MO 




' 8.00 




(Sym) ' 












A* 


4.00 
6.00 


2.00 

3.00 4,50 










1 


0.137 


0/1169^ 




-8.00 


-4 00 -6.00 


8.00 














' 3.25 


(Sym)' 
















B* 


7. 75 
1 1 75 

' 2.00 


30 . 50 

28 50 42.50 

J 

(Sym) ■ 










2 


0.004 


0.0002 

• 


(AB)* 


■ -1 .00 


0.50 










1 


0.144 


0.0371 


Error 


7.00 


-3.^0 24.50 














, . 


, ' 1.250 








1 






- 




A* 


: 0.667 


0.667 
















0.583 


0.333 0.500 








6 








,0.000 

V 


-0. 167 ^ 0. 167 


0.667 

J 










■ - 


' 0.583. 


<Sym) ' 
















-0.250 


0.500 










6 








0.083 


0.167 0.833 












t. • 


(AB)* 


' 0.583 
-0.250 
0.083 


(sytn) " 

0.500 

0.167- 0.833 ^ 








6 







Alternatively, testing A, 8, and AB with the post matrix A normalized, 
tfie fol lowing matrices are employed 



16 . 



Cj^ a (I -I) and A = 



(j- j1 and l*n 



•I) and A = 



0.707107 
-0.707107 
0.000000 
0.000000 

0.707107 
-0.707107 
0.000000 
0.000000 



4 
I 

J 



0.40824^ 
0.408248 
-0.816497 
0.000000 



0.408248 
0.408248 
-0.816497 
0.000000 



0.288675 
C. 288675 
0.288675 



\ 



^.866025 



0.288675 "I 
0.288675 
0.28867^ 
-0.866025 



The MANOVA table for this analysis Ife displayed In Table 8. 
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Tab lb 8. Multivariate Profile Analysis II 



Hypotheses 


MSP = SSP/v • 


OF 


A 


p- va 1 ue 


A 






3.125 






1 • 


0.250 


0.2070 




C 


;! 2.250 




(Sym) 


* 










B 




10.825 


52.083 








' 1 


0.027 


0.0014 






17; 759 


. '85.442 


140. 167 

J 














1.000 




(Sym) 












AB 




0.000 


0.000 






1 


0.144 


0.0371 




I 


4.287 


0.000 


18.375 










Error 














• 




A 





^ J 


1.563^ 






6 




. - 






0.292 




(Sym) " 




« 






-■ 


B 




0.024 


0.264 
















0.068 


0:334 


0.965 

J 






r 








0.292 




(Sym) ' 










AB 




0.024 


0.264 
















0.068 


0.334 


0.965 












- h 


1 















From the entries fn Table 8, the univariate F-rat?os for testing A, B 
and AB are Immedfately obtained by averaging the diagonal elements In the MSP 
matrices, the corresponding diagonal elements In the"eT;ror mean square and 
products matrices, and formJnq the natTo of these averages, Tfrnn and Carlson 
(1973). That Is, , f 

3. 125 

F. » = 2.00 'V F(|,6) 

1.563 ^ ° 
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194.50/3 64.83 „ 

« =- = 127.88 -v, F(3, 18) 

" 1.521/3 0.51 

19.375/3 6.46 

•"ar = ^ — ^ = = 12.74 -v, F(3, 18) 

1:521/3 0.51 

The hypothesis and error deqrees of freedom for each univariate F+ratlo are 
obtained by multiplying the deqrees of freedom for each multivariate test by 
the rank of the post matrix A corresponding to the test. Hence, for the ratio 
Fq the unlvarl.ate deqrees of freedom are * 

' ; = VgRCA) = 1.3 == 3 

= v^R(A) =^6-3 ==18 

e © . ; 



The others fol low similarly. 

To Invest ! gate treiKJs In sp I It-plot designs, Potthoff Roy's (1964) 
multlvjirlate unrestricted full rank linear growth curve model 

(20) ( Y W B . P + € 

! • o ' o 

N X q N X g g X p p X q N X q 

Is employed where 

E(Y ) = WBP 

o « 

V(Y ) « L. BE 

The matrix Y^ I9 ^ data matrix, W Is a known ful l rank design, matrix, B Is an 
unknown matrix of regression coeff icients, P Is a i<nbwn matrix of rank pi <^ q. 
Is the^ranidom error natrix, and~ the rows of are- Independently normal ly 
distributed. Implicit In the model Is the assumption that each vecfor response 
"Varl^te^can^ be ex pr'essed ds a linear regression model of the form. 
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where ^j(q x 1) Is the observation vector^for the 1^*^ subject and gj Is a 
vector of unknown repression parameters. 

To~reduce model T20) to model (9), Potthoff and Roy suggested the fol- 
lowing transformation of to Y, 

(21) • V = Y G^'p^CPG^'p')"' 

o 

where 6(q x q) !s any symmetric positive definite weight matrix either non- 
stochastic or Independent of Y such that.PG"^' Is of full raik. ?lnce W has 
full column rank, an unbiased estimate of B, under the trarjs format Ion, Is 

(22) 8"^= (W'W)^'w*Y 6"'PMPG"'PM"' 

o 



JUndari-the -trans#orH^na+^on7"^a^ dTsTrTlnita^'wTth variance- 

covar lance matrix 

z =^ (pg'^'p^)'*^pg"'^'g'' 

Q: ^ ■ ■ ' 

P X P 

however, the minimum variance unbiased estimator of B Is 

(23) B = (W'W)"'w'Y E^'p'br P')"' 

o o o 

This Is unfortunate since Is usually unknown In practice* 

Notice however, that If p q, .the transformation defined In (21) re- 

.. ' . .■■}'*■" ■" ' ' • 

duces to ' ' : . 

(24) * y = Y P"' 

V ■ ' O .■ - • . 

\ ■ • I - . ■ - . 

\^ - . . ■■ ■ • . ■ . . . , 

SO Th^ there Is no need to choose G. Bock (J963b), developed a procedure for 
this caseHjsIng orthogonal polynomials* . .. 

If p <<K however, the choice of G Is Important since It affects ttie 

power of tests and the widths of confidence bands. The variance of the estimator 

^ ■ ■ -I X- -I- " - 

B Increases as G ' departs from . A slrr«ple choice of G Is to set G = I. 

Then 

(25) 



ERLC 
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Such a choice of 6 will certainly simplify one^s calculations; however. It Is 
not the best choice In terms of power since I nf or/rat I on U lost by reducing 
to Y uriless 6 Is set equal to Z^. This suggests Obtaining an estimate of 
based on the -data • Khatrl (1966) showed that the maximum I Ike II hood est I 

o 

mator of 8 Is given by 

(26) . B = (W'W)"'w'Y'X"'p'<Pr 'pM""' ^ 

. o o o 

where Is the maximum likelihood estimator of defined by 
o o ' 

E = Y'(I-W(W»W)*'wMY /N 
o o o 

Alternatively, we could have used 

— ^-1^-,^- — — — 

S = Y»(T-W(W»W) 'WMY^.or S « S/CN-|) 
o o 

Instead of E^ since B does not change for these estimates • 

To avoid. the arbitrary selection of the matrix G under the Potthoff-Roy 
model, Rao (1965, 1966) using the method of covarlahce adjustment showed how 
additional Information In tHesample Y^ could be recovered by Incorporating 
Into the growth curve model (q-p) covar fates. However, It Was Grizzle 6nd 
A I |en ( 1969) that unified the previous apprpaches. They showed how Rao^s re- 
suits us I ng^ covar lance model were IdentlcaT to KhatrMs result, and de-- 

■.■ '. '\ 1 
" \ . \ ■ '**|. 

scribed a procedure for using stochastic weight matrices other than E^ If It 

was desirable. 

In summary; when p < q the Potthoff-Roy reduction using G = 1 Is equl- 
valeht to not using covarlates jn the Rao-Khatrt formulation. If the' weight 
matrix Q ^ E^ In thd Potthoff-Roy transforniatlon, this ' Is' equivalent to using 
q-p covarlates, In the Rao-Khatrl reduction. When p = q, the Rao-Khatrl proce- 
dure Is not applicable since the Potthoff-Roy transformation does not depend 
on 6. That Is,, the estimate for B obtained by Rao using (q-p) covarlates, by 
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Khatrf using the maximum Mkelthood procedure and by Potthoff and Roy weighting, 

-I "^-1 . * 

by G " ^f"® Identical* The varlance-covarlance matrix of B Is given by 



(27) 



Var(B) = (WW)"' « 



N-q-l 



N-g-q+p-l 



(Pr'p')"' 
o 



Rao (1967) and Williams (1967). 

Hypotheses of Interest undet^ the growth curve model are usually stated 

In the form - 

■ - * • 

(28) , H: C'BA "0 

where C*<Vj^ x g) Is of full row rank v^^ and A(p x t) fs of full column rank t. 

Using Potthoff and Roy's (1964) procedure for testing H, the data matrix 

Is transformed to Y using the transformation ' ~"~ 

Y = Y G"'pMP6"Vm"' 



and hypothesis and error sum of squares and products matrices become 



(29) 



« (C'BA)'(C'(W'W)"'C)"'(C'BA) 
S = A'Y'(I-W(W'W)^'wMYA 



The hypothesis Is rejected If 

where v a N-g. However, Potthoff and Roy*s formulatI6n\does not allow G to 
be stochastic unless It Is Independent of Y^« That Is, G must be chosen In- 
dependent of the experimental data under Investigation. Hence, we may not set 

G.» S . "■ ■ " • 
o 

' - ^ .. 

Alternatively using the Rao-Khatrl reduction^, we may select a G; how- 



ever, then 
(30) 



= (C'BA) '(C'RC)"' (C'BA) 

S = a»(pe"'p')"'a 

e o 
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and 



R « (W^W)*'-H(W'W)"'w»Y (E"'-r'p»CPS"'pM"'pS"')Y»W(W»W)' 

o o o o o o 



The hypothesis Is rejected us!nq this procedure If 

where ^ - N-g-q+p. If p = q both procedures q?ve Identfcal results, 
— To- ana I yze Kl rk ' s- da ta~us f ng: the growth eurve- mode 1, ^•h« mode I ! s 



W 



B 



6 x4 8x2 2x 4 4x4 8x4 
tf we assume that p where 

' I 0 ^ 



3 4 ^7 

6 5 8 

3 4 1 
3 
2 
3 
4 
3 



3 
I 

2 
2 
2 



6 
5 
6 
5 
6 



7 
8 
9 
8 
10 
10 
9 



W 



I 0 



0 
0 
0 
0 



I 



B 



'10 



II 



12 



13 



^20 ^21 ^22 ^23 



Using a matrix of normalized orthogpnal pofynomlals for the matrix P, 

/ .5 .5 .5 .5 

-.67082 -.22361 .22361^.67082 

.5 -.5 -.5 .5 

-.22361 .67082 -.67082 .22361 
The functional form of the polynomial fit to the data using (31) Is 



(31) 



P = 



V 
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for X = I, 2, 3, 4. Alternatively, an unnormalfzed matrix of orthogonal poly- 
nomials could have been used* Then" 

I I t 
-1 13 

P = ■ 



and 
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{ 1 0x3^75x2+ 1 67x- 105 1 

; \ a_ 



for s = I, 2, 3, 4. Finally, If a Vandermode matrix Is used. 



P = 



1 2 


3 


4, 


1 4 


9 


16 


1 8 


27 


64 



and 



ifor X = 1, 2, 3, 4. The reason for selecting (31) for P Is that the transfor- 



mation from to Y becomes 
o 



(32) 



Y = Y ' = Y P' 
o o 



since P Is an orthogonal matrix. Furthermore, 



B = (W»W) ^W»Y^P» « Y.PV ^ 

where Y.' Is the matrix of means. Notice however that If p < q, G I and P Is 
defined as In '(3|) with 



P « 
q X q 



er|c .a 



and P,(p X q) the fIrSt p rows of P that the transfornatlon from Y to Y Is 

I ! ■ O v 



so that 



Y = Y F»|<PP')"' = Y P! 

o I I' , . o I 



■ I. ' 
8 = Y P! 



which ts equivalent to el ImlnatJng q-p columns' of under the transfbrmatfon 
given In (32) or fqnorfng the q-^p covar fates fn the f^p-Khatrl reduction. If 
p < q under the R^-Khatrl formulation/ 

1 ' - 1 -I 
B P»'P,E PI) ' ^ 

- ' . */ ' . . ■ • ■ , 

which fs not. the same as B usfnq G =1. . . ' ^ ^ ' 

In analyzing a split-plot design we first plot the means, Por Klrk*s 



data^ 



/ 



the means are plotted In Figure 2. 



10 --• 

9 -- 
8 -- 
7 
6 ■- 
5," 
4 ■- 
3 - 
2 




■A, 



A.:.- 



B. 



B, 



Figure 2. Means f6r Klrk^s Data 
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from Figure 2, It appears that the trend for Aj ts cubic but that the trend 
for A2 Is quadratic. This distinction In growth curves cannot be made using 
model <20) since Ithpllclt In the model Is the assumptlbn that the-^pected 
value of each tndfvldual's response Is from the same. family (some (p-l) degree 
polymonlal). This sometimes causes us to overf It some growth cUV-ves, Modeis 
which avoid this are discussed by Klelnbaum (1970, 1973b). 

With the growth curves plotted, we cetn either determine whether the 
growth curves are quadratic rather .than cubic and then test for parallelism 
with p < q or we rndV test for para j lelism with p « q and then determine the 
degree of the polymonlal required 4o describe the growth curves. For the 
T I rst. procedure, the matrices to test that the cubic term Is zero are 



t o 

0 I f 



and A •» 



0 
0 
0 

I U 



TheWe are u^ed-to iest the hypothesis 



C/ H: B = ^ 0 



If this bypoth^lV Is tenable; the para I Jell sm hypothesis would be fesfed by 

• ^ \ ' ' ' ■: . ■ ' 

setting' • 



C «: (I -I), A 



0 0 
10 
0 1- 



and 



(32) 



..5 .5 ; .5 .5 

-.67082 -.22361 .22361 .6,7082, 
.5 -.5 -.5 - .5 
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with p < q and G - "for +he Rao-Khatrl procedure or G = I usfng the Potthoff 

Roy technique. The hypothesis belnq tested Is 

t 

(33) 



8|| 
^12 J 



021 
I ^22 J 



Alternatively, we may test for parallelism with p = q. The hypothesis Is theft 









021 


(<34) H*: 

P 






^22 




. 0|3 . 




. ^23 . 



and the, matrices C and A are defined by 

r 0 



C' .= (I -I) A = 



0 
0 



0 
0 



0 1 

0 
0 



Using this latter procedure for Kirk's data, 

r 11.375 '3.522 0.375 



10.125 6.093 



-1.062 
1.625 0.168 



S. = (C'BA)'(C'(W'W)"'C)"'(C'BA) 

n f 

= (C'Y.P'A)'(C'(W'W)"'C)''(C'Y.P*A) 
= A*'YlC(C'(W'W)"'c)"'c'Y.A* 



where A* = P'A which satisfies the condition that A*'A* = I as. In profile 
analysis sine© P Is orthonormal and 

■ , S = A'PY'(I-W(W'W)"'w')Y P'A 

e o o ^ 

= A*'Y'(I-W(W'W)"'w')Y A* 

o o 



For Kirk's data. 
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9^ 



' 1.653 (Sym) V 

0.804 0.391' 

[ 0.791 0.384 0.378 

and Wllks* A-crltelron Is A 0,144. Comparing A with the a = 0.05 critical 



0.759 (Sym) ^ 

0.203 0.234 

0.034 -0.049 0, 147 



value, l/*(3, I, 6) = 0.1683, the parallel Ism hypothesis Is not .tenab le. The 



-p--vatu0^or^t)e^^est""|5 otp^ 0.0371. As expected, this result Is Identical to 
the multivariate test of Interaction In profile analysis for the transfor- 
mation given In (32). For this reason, the Interaction test In profile anal- 
ysis is often referred to as the test of parallelism. / 

To determine the degree of the polynomial required to describe the re- 
jection of the parallelism hypothesis, univariate F-tests are constructed by 
dividing the diagonal elements of and by their degrees of freedom and 
forming univariate F-ratlos, That Is, beginning with the highest order term, 

0.378/1 



cubic 



quadratic 



1 1 near 



0.147/6 
0.391/1 
0.234/6 
1.653/1 



«= 15.43 'v F(|, 6) 



10.02 F(|, 6) 



= 13.07 'v F(I, 6) 



,759/6 

Comparing each F-ratIo with F^*{|, 6) - 11.09, where a* = a/3 = 0.05/3 = 0.0167 
to control the error rate at a nominal level less than or equal to ^, we be- 
gin by testing the higher order terms first and we stop testing when the first 
significant F-ratIo Is reached. For Kirk's data, a cubic trend best describes 
nonparal lei Ism. This procedure Is seen to be Identical with the univariate 
analysis. If p < q, this Is iliot the case. 

If the parallelism hypothesis Is tenable, we would next test to see 
whether the growth curves are coincident. Of oourse, we could test this 
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without first testing for parallelism. To test for coincidence with p< q 
(the cubic term being zero, say), the hypothesis Is 



<35) 



H 



P|0 




r ft 1 

^20 






$21 


L P|2 . 


• 


I ^22 . 



with 



C ,= (I -I), A = I, 



/ 



R defined In (32), and G = I or G = depending on whether we use thei Potihof f- 
Roy model or the Rao-Khatrl model. With p=q, the test for colncldencei Is 



(36) 



B|0 




^20 


^11 




B21 


3|2 




$22 


^13. 




^ ^23 - 



Tfiein 



C = (I -I), A » 



and P in (31) are used. When p « q, this test Is Identical to testing the 

' \ ' ' ' ■ 

hypothesfs A* fn profile analysis. 

Another test which may be of Interest when p = q Is the growth hypothe- 

S\i 1 

(37) 



ThI 
If 



f ■ ^ 

Pll 


- ^ . 


^12 


• 

S 


«I3 




' 0 " 


. ^2, . 




> ^22 - 




' ^23 ' 







- G* 



5 Is Identical to the test of B* In proflln analysis. This Is not the case 



.1 



If ^he parallelism hypothesis Is tenable, but the coincidence test ls< 
rej4ctod, we may still Investigate trends over B with the trend hypothesis; 
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(38) 

!f p = q. For this test, 



C = (I I) and A = 



0 0 0 1 
m 

10 0 

0 1 JCL 



0 0 1 

This Is equivalent to the test of B studied In profile analysis. To see this 
using Kirk's data, even though the para I lei Ism hypothesis Is not tenable. 



r 23.112 (Sym) ' 

4.808 1.000 - 
-2.150 -0.447 . 0.200 J- 



and = 
e 



.0.05 



f 0.759 (Sym) " 

1 

0.203 0.234 
0.034 -0.049 0.147 



so that A = 0.027 which Is compared to.U^j , gj = 0.1683. As claimed this Is 
the result reported for testing B In Table 8. To Investigate trend following 
the test of Hj, we proceed as we did when testing for parallelism when p = q. 
That Is, ■ 

0.200/1 



cubic 



0.147/6 
I .000/1 



quadratic , 0.234/6 
/ 23. 1 12/1 



1 1 near 



8.16 F(l, 6) 



= 25.64 1, F(l, 6)' 



182.71 <v F(l, 6) 



0.759/6 

I- 

As expected, these results agree w-Ith those given In Table 3. 
If p < q, the test of would be written as 



(39> 



' 1=1 " 1=1 



If the cubic term Is zero. 



Glvjfi that both the coincidence and p^raf lellsm hypotheses are tenable, 
we would analyze the data for trend over B with either the Potthoff-Roy or 
Rao-rKhatrt models by treating the data as a single qroup. The advantage of, 
this procedure Is that the degrees of freedom for error are Increased since 

the variation attributed to the group by conditions variation Is pooled with 

%^ _ . ■ 

error. — 

3. Multivariate Prof I le Analysis of Splft-Spllt Plot De.'^rgns 

The problems Inherent In the analysis of a spl It-plot design become 
more complex In a split-split plot design. The classical univariate mixed 
model for the simplest type of spl It-spl It 'p lot design Is 

, +S(,)j+(6s)(,)j^+(Ys)(,)j„+e(,)jk^ 
\—\^m»»fTf J" If • • • f J f k~ \ f • • • 9 K# m^. If • . . f M 
where s^^j 'x. IN(0, pa^) , <0s)(,)j^'V' IN(0, P^^^ » <Ys) ( | ) IN(0, pa^) , 

Independent. Thus, the varlance-covarlance matrix satisfies the compound ^ 
symmetry assumption. Assuming a 3^ factorial design within subjects, the lay- 
out for the design specified In (40) Is given in Figure 3. The Sj In Figure 
3 Indicate tliat subjects within each level of A are observed repeatedly over 
all levels of B and C so that the units of measurement are commensurable over 
B and C. ' \ 
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Figure 3. Simple Split-Plot Design 



Using the artff?cfal data fn Table 9 and the restrfcted ful! rank Ifnear 

mode I 

^IJkm ^ ^IJkm ^(I)Jkm 
(41) subject to the I(J-I)(K-I)(M-I) linearly 

Independent restrictions 

^IJI^'*^IJ*km"^IJk'm'*'^IJ»k'm''^IJkm»"^^IJ'km'^^IJ^^ " ° 

the ANOVA analysis for the data Is shown In Table 10, 



Table 9. Data for Spl It-Spl It Plot Desfqn 
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O 1 


32 


42 


37 


32 


. • 
32 


32 


^2 


O / 


A Q 

. **o 


29 


43 


56 


48 


39 


40 


41 


^3 








27 


28 


30 


31 


33t. 


34 




AO 


VIA 

40 


3o 


37 


36 


28 


19 


27 


35 


5 


^ / 


45 


3Z 


27 


21 


25 


30 


29 


29 


^6 




jy 


JO 


46 


54 


43 


31 


29 


28 


^7 


43 


32 


20 


33 


46 


44 


42^ 


37 


31 




35 


34 


34 


39 


43 


39 


35 


39 


42 


^9 


41' 


32 


23 


37 


51 


39 


27 


28 


30 




39 


32 


24 


30 


' 35 


31 


26 


29 


32 


c f 

^) 


4/ 


36 


25 


31 


.36 


29 


: 21 


24 


27 




53 


43 


32 


40 


48 


47 


46 


50 


54 


^3 


38 


35 


33 


38 


42 


45 


40 


48 


49 


^ f 

^4 


60 


5i 


41 


54 


167 


60 


53 


52 


50 


^ f 

="5 


37 


36 


35 


40 


45 


40 


34 


40 


46 


i-. f 

'6 


59 


48 


37 


45 


52 


. 44 


36 


44 


52 


t 


67 


50 


3,3 


47 


61 


46 


31 


4l" 


50 




43 


35 


27 


32 


36 


35 


33 


33 


32 


H 


64 


59 


53 


58 


62 


51 


40 


42 


43 




41 


38 


34 


^' . ■ 
41 


47 


42 


37 


; 41 


46 



Table 10, Unlvarfate Profile Analysis 



Hypothesis 


SS 


OF 


MS 


F 


P-value 


{ . Constant 


275968.66 


1 


275968.66 






*775.08 


<.000l 


.2. A 


3042.22 


1 


3042.22 


4' 




8.54 


0.0091 


3. S(A) 


6408.90. 


18 


356.05. 










4. B 


634.84 


2 


317.42 


^6^ 




3.29 


0.0487 


5. AB 

6. SB(A) 


18.71 
3489.48 


2 
36 


9.36 
96.93 






0.10 


0.9051 


7. C 


427.81 


2 


213.91 






14.95 


<.000l 


8. AC 


" 6.21 


2 


3.11 




a 


0.22 


0.8036 


9. SC(A) 


515.16 


36 


14.31 






■4 




10. BC 

1 1 . ABC 


2440.89 
67.36 


4 
4 


610.22 
16.84 


,IOy 




27.64 
0.76 


<.000l 
0.5547 


12. Error 


(589.76 


72 


22.08 






1 




Total. 


294610.00 


180 









Using the population means In Table 11 for the J^^ subject within 
the 1^*^ level of A, the hypotheses being tested In terms of the full rank 
model parameters are summarized I n Tab I e 12. 

Table N. Fopulatfoh Means 







«2 










C, Cj 


C, C2 






"|JI2 »'IJI3 


^|J2| ^!J22 ^IJ23 


^IJ3I "!J32 
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Table 12. Univariate Prof I le Analysis Hypotheses 



Source 



Hypotheses 



OF 



Constant 
A 

S<A) 

B 

AB 

SB(A) 

C 
AC 

SC(A) 

BC 
ABC 

E^ro^ 
Total 



W =0 

• • • • 

ally, are equal 



IJ.. 



al I M . are equal 

^jk.-^j'k.tijk'.-^^j'k'. 



"ijk.-^ij'k.-^ijk'.-^^ij'k'. 

al I y 's are equal 
. . ,rn 

V, -V,, -V, ,+y,i , 
I..m l'..m I..m' I'..fn' 

"lJ.^ii""lJ«.rT.""lJ.m''^"lJ'.m' 



km"" .. k ♦ m"" .. km k 'm' 
"l.J-^-^f.Jm-^I.J'm^^'.J'm 



= 0 



"I 



= 0 



"1 



'I.Jm''*""l'.Jm'""I.JV 
(Same as the restrictions In 



P.J'm* 
(41)) 



= 0 



I-l 

KJ-O 

K-l 
(I-I)(J-I) 

I(J-I)(K-I) 

1 

(M-l) 
(I-DCM-I) 

I(J-I)(M-!) 

<K-I)(M-I) 
(I- 1) (K-l) (M-l) 

IJKM 
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To analyze the data tn Table 5 usfnq the unrestricted full rank mult! 
vartafe linear model, the means In table 13 are us^d to construct U and the 
design matrix Wis " 

0 
0 
0 
0 
0 
0 
■ 0 
0 
0 



(42) 



7 
9 



w = 



0 
0 
0 
0 
0 
0 
0 
0 
0 



Table 1 3. Multlvar 



ate MeansiL 







S| 






^2 






^3 






C, 


^2 


K 




^2 


. 93 ■ 


% : 




C3 . 




»^ll 




"13 


"14 


"15 


"16 


"17 


"18 


"19 


"2 


^^21 


"22 


"23 


"24 


"?5 


"26 




V28 


"29 
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The first hypothesis of Interest using the multivariate model Is to, see 
whether there Is an Interaction between A and the levels of B, C and BC which 
we shall now call the test of parallelism, Foi lowing the formulation for 
testing Interaction (parallelism) for a split-plot deslan, th« matrices needed 
to test for paral lei Ism, rwNh the hypothesis stated In the form C'UA » 0, are 



(43) 



\ ■ 


f 1 


0 
0 




0 


1 

-1 


0 9 

1 0 


0 ' 
0 








0 

1 


0 


0 


0 

-1 


-1 0 

0 1 


0 
0 




an8 A = 




1 

I.: 


0 




1 

0 


-! -1 

1.0 


1 

-1 . 






0 


-1 




0 


0 


0 -i 


0 






0 


-1 






0 


0 1 


-1 






0 


-1 


0 




0 


o-"' 0 


1 





BC 



when 



(44) 



U = 



y|| y|2 V|3 V|4 1^15 1*16 ^17 ^19 
U2I V22 ^^23 ^24 ^25 ^26 ^27 ^28 ^29 

If. 



Th^ first two columns ^f the post'matrix A are formed to evaluate AB, the 
next two are used to Irtvestlgate AC, and the last four, constructed from the 
first two by ta)<Tng Hadamard vector products, are used to test ABC* Normal- 
izing the post matrix A so that A'A » I and separating out the submatrlces 
uised to test A8, AC, and ABC, we averiage the diagonal , elements of : the sub- 
hypothesis MSP and error component matrices, as we did for the split-plot 
design, to obtain the univariate F-ratIos<. If the design on B and C Is a 
2^ rather than a 3^ design, the clagonal elements of the MSP matrix contain 
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the univariate «»an squares for testing the univariate hypotheses AB, AC, and 
ABC.-- \ 



To test BC, given that the parallelism hypothesis Is tenable, the ma- 



trices 



C = (I I) and A = 



1 


0 


0 


,0 


0 


1 


0 


d 


-1 


-1 


0 


0 


0 


0 


1 


0 


0 


0 


0 


1 


0 


> 0' 


-r 


-1 


-'I 


0 


-\ 


0 


0 


-t 


0 


-1 


1 


1 


1 


1 



are used. ^ The p6st matrix A Is constructed by arranging, the elements of U 
In table form. Table 14, and forming four linearly Independent contrasts such 
that . . ^ " - 

Table 14. Rearranged Means for the SpTlt-Spllt Plot Design 











^2" 

ft 




"^3 




• 


^1 ' 




^2 






« 

«l 


^1 


= ^11 


"12 


= "12 


":3 


' "13 


^1 


"21 


""Vl 


"22 


-0,2 


"23 


' "13 




"14 




"15 


= ''22 


"16 


' "23 


«2 


"24 

> 


= 02, 


"25 


V"l2 


^6 


= ^23. 




"17 


= ''31 


"18 


= 032 


"19 


= "33 


^ ^3 


"27 


= "31 


"28 


" "32 


"29 


" ^33 



Normalizing A and averaging the. diagonal elements of the hypothesis and error 
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mean squares end products matrices, the univariate F-ratlo for testing BC Is 
Irnmedlately obtained* If the .parallel Ism hypothesis Is not tenable, we may 
test BC with (BC)* by using C » and the oost watK-x A deffcoed In (^45). 
The univariate test of 3C Is not obtained from testing (BCl*. 

To tes+ the main effect ^>ypotheses A, B and under parallel Ism and 
n6 BC Interaction, w6 use the following matrices for C and the post'matrlcesi 
A when the hypotheses are expressed In the form C*UA » 0: 

I 



(A): C» « (I -I) A 



1/ 



•J 



/ 



(3): C»- a (I 1) A '= 



1 
0 
0 
0 
-I 

-r 

-I 



0 

0 
I 
I 
I 

-I 
-f 



(47) 
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C = (I 1) A = 



-I 



0 
I 



) 0 
0 I 
-I -I 



0. 



, Normalizing the post matrices A In (47), univariate tests are eas I ly obtained. 

Tests of A, B, and C which do not require parallelism are denoted by 'A*, B^,, 
. ahd C*.. the matrices defined below are used to test these hypotheses. 

(A*): C = (I -I) A = I„ 



(B*): C = L 



0 
0 
0 



0 
0 
0 



(46) 



-I 
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(C*): C' = l2 A 



0 
-I 



To write each of the multivariate hypotheses In terms of the elements of 
U, ql^n In (44) for^'the example, we merely have to substitute the hypothesis 
test matrix C* and the post matrix A Into the qeneral expression for C^UA = 0 
for each hypothesis. To test each of the preceding hypotheses, the expressions 

for and given In ( 12) are evaluated using the data In Table 9. To show 

■ ■ ■ "\ 

the correspondence between the multivariate analysis In TatH^ 15 and the univar- 
iate analysis In Table 10, the mean square and products matrices are displayed; 
the post matrix A for each hypothesis without an asterisk (*) has been normaJ- 
I zed so that A»A = I. • 

Averaging the diagonal elements of the hypothesis test matrices of AB, 
AC and ABC within Paral, BC, C, B and A In Table 15 and the diagonal elements 
of the corresponding error matrices, univariate spllt-spUt plot F-ratlos are 
Immediately constructed. To Illustrate, we test ABG and C: 



{ 5. 5 1 5f 2. 604+ 1 1 . 704+47, 535) /4 16.48. 



ABC 



(20.357+31 .497+8. 778+27. 700) /4 22.08 



» .76 



(26 1. 075+ 166.736)72 213.91 



= 14.95 
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Table 15. Multlvarla^te Profile Analysts of a Split-Split Plot Design 



Hyp. 



Para! 



OF 



BC 



C 
B 

A " 
(B.C)» 

C* 
B« 
A* 

Error 
Para I 



BC 

ERIC 



MSP 



18 



18 



0.033 
0.789 
0.367 
0.269 



(Sym) 



18.678 
8.679 
6.378 



-0.429 -10. 147 
-0.295 - 6.974 
-0.625 -14.785 



^AC 
4.033 _ 

2.964 2.1781 

4.715 - 3.465 

3.241 - 2.381 

6.871 - 5.049 



■1.529 -29.797 -1 3.846. -10. 174 



(Sym) 



5.513 
3.789 
8.032 
16.188 



ABC 



2.604 
5.521 



.704 



I 1.126 23.587 47.535 



1872.1 13 ■ 

13.965 0.104 
-712.198 -5.313 270.937 
746.587 5.569 -284.020 297.735 



26 ! .075 
208.640 



(Sym) 
166.736 



I 

f 1^.133 (Sym) 
\ 272.201 480.711 



3042.22 



(Sym) 



3870.251 
1956.651 989.300 
■ 723.750 364.200 166.500 
1508.051 762.200 285.900 588. 100 



4 



783.23 
933.67 



( 



f 506.50 (Sym) 
\ 980.40 1944 



(Sym) ) 
1113.03] 

' 1 
. 40 j 

(deleted, lack of space) 



_ AB 
^6.313 

25.606 97.551' 
20.619 I .749 
9.998 ?4.64Q 
-9.445 10.182 
14.754-7.007 
22.132 5.946 
20.531 25.214 -0.870 



AC 
'7.185 

6.836 20.80 r' I 
0.982 16.135 20.357 
10.144 18.444 18.335 31.497 
2.214 0.538 -0.256 2.997 
6.548 9.002 



(Sym) 



ABC 



8.778 
5.106 12.761 27.700' 



44.424 

-0.314 0.099 
-9.057 0.002 
6.008-0.025 



34.188 
-2.217 



(Sym) 



9.622 



43 



Hyp. 

■ • 

B 
A 

(BO* 



C* 

B* 

A* 
p-va I ues 



DF 

18 

i8 

18 
18 



18 



18 



18 



MSP 



f 23.475 (Sym) ] 

[ 2.205 5.141 J 

r I 19.417 (Sym) ] 

[ -12.267 5.141 J 



356.05 



(Sym) 



t 17.694 

87.761 43.633 

57.472 28.200 115.611 

46.217' 22.922 136.775 53.544 

{ 140.850 (Sym) ] 

[ 81.883 628.250 J 

f 716.500 (Sym) ] 

[ 294.51 I 450,400 J 

(deleted, lack of space 



Para! 

BC 

C 



0.9392 
<.000l 
<.000l 



B 
A 

(BO* 



0.0356 
0.0091 
0.0012 



C* 0.0005 
B* 0J357 
A* 0j5li4 



Using the growth curve model In (20), a trend analysis of the data In 
Table 9 Is easily carried out once the post matrix P Is constructed. -Unlike 
the split-plot example, trends' over the within subjects dimension, factors B 
and C, are not over all nine points but within levels of B and C. That Is, we 



have on ly three itlme points and not nine, 
nomlais for three time points are 



I 



Constant 
Linear 



Quadratic g' = ' -2- 



'2 
I 



I 



The unnormallzed orthogonal poly- 

Sum of Squares 
3 
2 
6 



id 
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To extend these over nine points, defined by a 3^ factorial design, we form the 
following Kronecker products 
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^2 












C, 






^2 




C, 






8 r' 


s 1 


1 1 


1 




1 
1 


1 1 


1 
1 


or 






1 1 


Q 




0 


1 1 

1 1 


1 
1 


0' 


8 C* 




( 1 


-2 






1 1 

1 1 


^ 1 
1 


c* 


XX L. 




0 1 


1 


0 


1 


-1 0 




c 

A; 


18 0' 

'V 




-2 I 


1 


-2 


1 


1-2 


1 


1 » 

'\# 


8 L' 

1( 


a 1 




0 


0 


0 


7-1 0 


1 

1 


A* 






2 -1 


0 


0 


0 


1 -2 


1 


0' 


H L' 

A* 


s — 1 


0 1 


2 


0 


-2 


-1 0 


1 


0' 


« Q' 


s 1 


-2 1 


-2 


4 


-2 


1 -2 


t 



Using nonnaJ I zed polynomials Instead of unnormallzed polynomials, the matrix 



P for the trend analysis Is defined by 



.333333 


.333333 


.333333 


.333333 


.333333 


.333333 


.333333 


.333333 


.333333 


-.408248 


-.408248 


-.408248 


.000000 


.000000 


.000000 


.408248 


' .408248 


.408248 


.235702 


.235702 


.235702 


-.471405 


-.471405 


-.47(405 


.235702 


.235702 


.235702 


-.408248 


.000000 


.408248 


-.408248 


.000000 


.408248 


-.408248 


.000000 .408248 


.235702 


.471405 


.235702 


.235702 


-.471405 


.235702 


.235702 


-.471405 


.235702 ' 


.500000 


.000000 


-.500000 


.000000 


.000000 


.000000 


-.500000 


.000000 


.500000 


-.288675 


.577350 


-.288675 


.000000 


.000000 


.000000 


.288675 


-.577350 


.288675 


-.288675 


.000000 


.288675 


.577350 


.000000 


-.577350 


-.288675 


.000000 


.288675 


. 166667 


-.333333 


.166667 


-.333333 


.666667 


-.333333 


.166667 


-.333333 .J 66668 



Analyzing trends using this procedure has already been discussed by Bock 
(1963b) and will not be considered here. For this type of analysis p Is always 
equal to q unless the model oven the within dlmeos'o" 's additive. For an ad- 
ditive, model we may either select G - I, using the Potthoff-lby model, or ^ 
6 » E , using the Rao-Khatrl formulation. 



4. Growth Curve Analysis and Profile Analysis of Multivariate Repeated 
Measuremr its 

The repeated measures type designs discussed so far In this paper were 

C 

such that the researcher bbtalned commensurable measurements on each subject 
over time or over several experimental conditions. In many experimental si- 
tuatlons, especially longitudinal studies, we often collect data on several 
varlates and observe a subject on each of the varlates oVer time. For profile 
analysis the time points are unordered experimental conditions. DesTgns with 
multivariate observations on p varlates observed over q time points or q con- 
ditions are called multivariate or multl -response repeated measures designs • . 
since the multivariate observations are not commensurable at each time point 
but are commensurable over time or conditions, a variable at a time. Figure 4. 
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q 
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VlJI 
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yiJ2 
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VIJI 
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y|J2 


A, s, 




Xijp J 






• 

(2) 
I Vfjp J 




... 




v(q> 



Figure 4. p-varlate Observations over q Cohdttlons 

Since each of the p-varlates are observed over q time points (or condl- 
tlons). It Is convenient to rearrange the data In Figure 4 by varlates for a 
multivariate repeated measures analysis sa that each varlate Is obsenved over 
q periods. Figure 5. The data matrix Y for the analysis Is of order N x pq 
where the first <| columns correspond to variable one, the next q Jfo irartable 2, 
the next q to variable 3 and so 4)n up to the p^^ variable. Alternatively, using 
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the data as arranged tn Figure 4 a multivariate mixed model analysts of varl- 
ance procedure may be us4d to analyze multl*-response repeated measures data. 
This would be done by sImplyMextendIng the univariate sum of squares In Tabie 
2 to sum of squares and products matrices and calculattng multivariate crir 
terfa to test hypotheses i However, for such an analysis we must not only as- 
sume a restrictive structure on the valrance-covarlance matrix associated with 
each variable over q time points but that the structure on each varlance-co- 
variance matrix between variables across time points Is constant. This Is even 
more restrictive than the univariate assumptions and for this reason Is not 
usually recommended. Instead, a multivariate approach should be used. 



Treatment Subject 
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• • • 
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^Ijp 
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^ijp 


A, s, 
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• 






■ ] 

• 




• • • 







Figure 5. Data Layout for Trend Analysis of Multivariate 
Repeated Measures Design 



The data In Figure 5 may be either trend or profile data. Although the 
analysis of profile data and trend data are very similar, as seen for example 
In the analysis of a split-plot design, we shal I consider each analysis separ- 
ately. For a growth curve analysis of the data In Figure 5, the mode f given In 
(20) Is employed. To use the model, the number of subjiects within ^ach treat- 
ment must be greater than or equal to the total number of measurements on each 
subject.- Eor-s^lmp 1 1 city , suppose that three measures are- recorded for^each 
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subject at q time points so "that associated with each subject are 3q measurements 
all correlated with unknown varfance-covarlance matrix I^. Letting the I growth 
curve for each of the three multivariate responses be represented by 

6|Q+S,I++ ... + e 
(49) e,«+9,,t+ . 



"^i.p,- 


,tP|-' 


P| 


<. ^ 


"^l,P2- 


jtV' 




<. q 


^«I,P,- 


,tP3-' 


P3 


1 ^ 



the matrices B and P are defined as follows: 

. t 



B 



g X (P|+P2+P3> 



^10 ^1 1 ••• ^l,p,-I 



20 "21 ••• ^2,p,-l ''20 °2I ••• °2,P2- 



^10 ®!1 ••• ^,P2-I 



^10 ^11.. 



^20 ^21 ••• ^2,p,- 



.P3- 
'3- 



I ^go ^gl 



(50) 



{ I 

t, 



P|+P2+P3^ X 3q 



0 
0 



0 
0 



0 
0 
0 



0 
0 
0 



0 



8 9 



g,pj-l qo ql g»P2-l 9° 9'- ?1»P3- 



0 

0 



0 
0 



+0,-1 

q 

0 
0 



0 
I 



0 
I 



tP2-' tP2-' 



P 
0 



0 
0 



0 
0 



0 
0 



0 
0 



0 
0 



0 

I 



.0 
0. 

0 



0 
0 



tP2- 

q 

0 
0 



^Pj-I ^.Pj- 



0 



0 
0 



tPj-l 

q 
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The design matrix W Is 





0 


0 


0 


«i»J2 


0 


0 


. 0 


0 


0 


0 


0 



w 

N X g 



0 0 J 

. g 
where 's a vector of J| unities for J j subjects within each of g groups 

where J I >^ pg. The matrix P given above has been represented as a Vandehrode 
matrix; atlematlvely, we could have used unnormallzed or normalized ortho- 
gonal polynomials. 

Tests cpmmonly Investigated with multi-response growth curve data are 
similar to unl -response data; however, we are Interested In analyzing trends 
for several different variables sImu^taneousty where the degree of the poly- 
nomial which "best" describes one varlate may be different for another varl- 
ate. We are, however, still restricted to fitting ia polynomial of the same 
degree to aSl treatment groups. 

To Illustrate some common mu I tl -response hypotheses, suppose that 
Pj = p2 Pj = q = 3 so that three varlates are observed over three time 
points and that the number of groups g = 2. Then, 



(51) 



B 



^10 ^11 
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«. ^20 '*2I ■ "22 



(52) 
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and 



(53) 



or 



\ - 



(54) 



P = 



1 


1 


1 


0 


0 


0 


0 


0 


0 


1 


2 


3 


0 


0 


0 


0 


0 


0 


1 


4 


9 


Q 


0 
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0 


0 


0 


0 


0 


0 


1 


1 


1 


0 


0 


0 


0 


0 


0 
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3 


0 
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0 
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1 


A 
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0 
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1 


I 


1 


0 
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1 


2 


3 


0 
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0 
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0 


0 
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4 
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p » 



or 
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0 
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0 


-1 
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0 


0 


0 


.0 


1 


-2 


1 


0 


0 


0 


0 


0 / 


0 


0 


0 


0 


I 


\ 


1 


0 


0, 


0 


0 


0 


0 


-1 


0 


1 


0 


0 


0 


0 


0 


0 


1 
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0 


0 


0 


0 
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0 


1 


1 


1 


p 


p 


0 


0 


0 


0 


-1 


0 


1 


. 0 


0 


0 


0 


0 


0 


1 


-2 


1 



-.408248 . 0()(X)00 . 408248 0 
.235702 -.471405 .235702 0 



0 
0 
0 



0 
0 
0 



(55) P = 
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0 
0 
0 
0 
0 
0 



0 
0 
0 
0 
0 
0 



_\. 

0 X,. 

0 
0 
0 



\ 



. 333333 . 333333, . 333333 
-.408248 .000000 .406248 
.235702 -.471405 .255702 
0 0 0 
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0 
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0 
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The first hypothesis of fnterest fs whether the regressfon functions are paral- 
lel for all variables simultaneously: v 



(56) 
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^11 




^21 
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'^11 




«2I 


®I2 
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^11 




h\ 


^ ^12 - 




• h2 ' 



This "Is tested by defining C and A as 
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C = (I -1) and A = 
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0 


0 


1 
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0 


0 


0 


0 


0 


1 



Given parallelism, to test for coincidence. 



(58) 



H, 



C" 



the matrloes C and A are given by 
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(59) 



C = (I -I) A 



I3 
0 

. 0 



0 

I, 



0 
0 

I, 



other hypotheses such as 



(60) 



or 
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5|2 




0 
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. 512*^22 . 







given parallel tsm, may also be tested« 
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To test that the, best* polynomial for a 1 1 variables !s# linear, we would 



use the test matrices 




(62) 



C = I2 and A 



0 


0 


0 ' 


0 


0 


0 


1 


0 


0 


0 
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0 


0 


0 


0 


0 


If 
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0 


0 i 
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0 


0 • 


0 


0 


0 


0, 
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Given that this 'hypothesis Is tenable, we have that pj < q, .Pj < P and 
Pj <'q. Hence, 



(63) 



and 



B = 



10 



8 



(64) 



P - 



L ^20 "2 1 



\ 
2 
Q 



0 
0 



I 

3 
0 



10 



'20 



0 



21 



10 



•20. 



•21 



0 0 I 



0 .0 



0 0 

a. 



We may now test hypotheses about the elements of the. (2x6) matrix how- 

fever, the selection of the* weight matrix G affects , the ana lysis. . Rao (1967) 

■ I . \ ' ■ 

and Grizzle and Allen (!969) point out that weighting does not always produce 

shorter confidence Intervals. By setting G = I, all the covarlates are Ig- 

nored and by using the Rao-Khatrl model the covarlates are applied to a I 
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other variables In the rrcdel. That Is, the 3q-P|-p2-p-5 covartates are used 
to adjust all the remalntnq' varlab fes simultaneously which Is exactly what 
Is done In multivariate analysis of covarl\nce designs. To use different 
covarlates with different sets-of dependent variables, the generalized growth 
curve multivariate model discussed by Klelnbaiim (1970. 1973b) Is (used. 

To analyze profile data for measurements arranged as In Figure 3, the 
unrestricted full rank linear model qlven In (9) Is used. Letting •. ^ 
~P7^' P2 = Pj = c|~=~3 for the arranqement of population parameters showA -In 
Table 16, we consider some hypotheses which might be of Interest for profile 
data. 

Table 16. Means for Multi-response Prof I !e Data 

/ - 

Variables ^ 

_ M - - ■ ' ■ 2-— ■ .3 



Conditions 



""TreaffneTTts 



Cj. C2 -C3 



^.11 ^2 ^13 



^21 ^22 "23 



Cj €2 C3 



'14 ^15 ^16 



^24 ^25 '^26 



17 •'(8 •'19 



^27 ^28 ^29 



The first hypothesis" of Interest for profile data Is whether the pro- 
files for each variable are parallel. That Is, Is there an Interaction be- 
tween conditions and treatments. Jhe hypothesfs may be stated as 
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(65) 



H 



(AC)^ 



^r^2 




^2|-»'22 






. *'22-"23 






''24-^25 


^5-^6 




^25-^26 


^17-^18 




"27-^28 






. ^28-^29 



The matrices and A to test H 



(AO* 



are 



(66) 



^(AO* ^ ^' 



I) and A = 



1 


0 


0 


0 


0 


0 


• 1 


1 


0 


0 


0 


0 


0 


-1 


0 


0 


0 


0 


0 


0 


1 

. I 


0 


0 


0 


0 


0 


-1 


. 1 


0 


0 


0 


0 


0 


-1 


0 


■ 0 


0 


0 


0 


0 


1 


0 


0 


0 


/ 0 


0 


-1 


1 


0 


0 


0 


0 


0 


-1 



|To tast for d^f^of-onces fri tf-eatrno nts, H^^^, whe reJH, 



(67) 







^21 


»^I2 




^22 


yi3 




'23 


•^14 




^24 


^15 




^'25 






^26 


•^17 




^27 


"J8 




^28| 


. V,9 . 
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1 

H^e matrl 



ces 



(68) 



C^,, = (I -I) and A = Ig 



are constructed. For differences In conditions. 



(69) 



H 



the test matrices are 



^11 




f > 

^12 






^ 1 










^4 










^^24 




.V25 




^^26 






•^le 










^ ^28 . 








1 


0 0 


0 


0 


- 1 


1 • 0 


0 


0 



(70) 



C^^f = I2 and A = 



0 ^ 
0 
0 
0 
0 
0 




Qlven parallelism, tests for differences. between the two treatments and amonp 
conditions are written as 
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(71) 



A: 



3 ' 1 




r 3 ] 


6 

T. \Ki t/3 


ss 


6 

E y, ,/3 


9 

s y. ,/3 
J=7 'J J 




9 

E y^,/3 



and 



(72) 



2 




f 2 . . ■] 




r 2 


I y,,/2 




I y,-,/2 
1=1 




E y,,/2 
1=1 










2 




s - 


2 y,5/2 
1=1 






2 




2 




2 • 


r y,7/2 
1=1 " J 




I ytR/2 
1 = 1 




E y,Q/2 







respectively. Hypothesis test matrices to test hypotheses A and C become 





r 1 

1 


0 


0 ' 






. 1 
1 


0 


0 






1 

1 


0 


0 






0 


1 

2 


. c 




= (1 -1) A = 


0 


1 

2 


0 






0 


1 

7 


. 0 






0 


0 


1 

2 






0 


0 


1 

?. 






0 


0 


1 

2 
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and 



(73) 



C' = (| A= 



1 


0 


0 


0 


0 


0^ 


0 


1 


0 


0 


0 


0 


-1 


-1 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


-1 


-J 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


-1 


-1 



Provided the post matrix A, for hypotheses stated as C'UA = 0, ^« normalized 
so that A'A = I, multivariate mixed model multivariate criteria are Immediately 
obtained from the multivariate approach for the hypotheses A, C, and AC, This 
Is not the case for the hyootheses A*, and (AO* as we showed for splIt-p|ot 
designs, T!mm and Carlson (1973). If the post matrix for testing the parallel- 
ism hypothesis Is normalized, the multivariate mixed model hypothesis AC Is 
Immediately recovered from the multivariate test. 



To Illustrate the procedures discussed In this section, data provided 
by Dh. Tom Zullo In the School of Dental Medicine at the University of Pittsburgh, 



displayed In Table 17 are used. 



1 \ 
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Table 17. Individual Measurements Utilized to Assess the Changes \ 
!n the Vertical Position of the Mandlbler at Three Time • 
Points of Activator Treatment 



SOr-Me 
(mm) 



ANS-Me 
(mm) 



Pal-MP angle 
(degrees) ' 



Group Subject 

Number* I 



1 


1 17.0 


1 17.5 


118.5 


59.0 


59.0 


60.0 


10.5 


I6i5 


16.5 


2 


109.0 


110.5 


Ili.O 


60.0 


^1.5 


61 .5 


30.5 


30.5 


30.5 


3 


Ii7.0 


120.0 


120.5 


60.0 


61.5 


62.0 


23.5 


p.5 


25.5 


4 


122.0 


126.0 


127.0 


67.5 


70.5 


71.5 


33.0 


/32.0 


32.5 


5 


116.0 


118.5 


1 19.5 


61.5 


62.5 


63.5 


24.5 / 

/• 

22.0 / 


/ 

24.5 


24.5 


6 


123.0 


126.0 


I27.D 


65.5 


61.5 


67.5 


22.0 


22.0 


7 


130.5 


132.0 


134.5 


68.5 


69.5 


71.0 


■33,o/' 


32.5 


32.0 


8 


126.5 


128.5 


130.5 


69.0 


71.0 


73.0 


20. p 


20.0 


20.0 


9 


113.0 


1 16.5 


11 8.0 


58.0 


59.0 


60.5 


25.0 


25.b 


24.5 



Means 



119.33 121.72 122.94 63.22 64.00 65.61 24.67 25.17 25.11 



2 
3 
4 
5 
6 
7 
8 
9 



T2H:Tr 

116.5 
\2l.5 
109.5 
133.0 
120.0 
129.5 
122.0 
125.0 



T27TU" 
120.0 
125.5 
I 12.0 
136.0 
124.5 
133.5 
124.0 
127.0 



-P5t79— 57nr~-ie7T5 69LjL^--a4^^— 24;Q 2 4. 0 



121.5 63.5 65.0 66.0 28.5 29.5 29.5 

}27.0 64.5 67.5 69 .X) 26.5 27.0 27.0 

114.0 54.0. 55.-5 57.0 18.0 18.5 19.0 

137.5 7^'.0 73.5 75.5 34.5 34.5 34.5 

126.0 62.5 65.0 66.0 26.0 26.0 26.0 

18.5 18.5 18.5 

18.5 18.5 18.5 

128.0 65.5 66.5 67.6 21.5 21.5 21.6 



134.5 65.0 68.0 69.0 
125.5 64.5 65.5 66.0 



Means 



122.78 125.72 127.28 64.28 66.00 67.17 24.00 24.22 ,24.29 
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From the mean plots of the data tn Table 17 for each group and variable 
Figure 6, It appears that the growth curves for the throe variables are at 
least linear.. Some other questions of Interest for the data Include: 

(1) Are the growth curves for the two groups parallel for one or 
more varlab les? 

(2) If we have parallel growth curves, for some variables, are they 
coincident? 

(3) What are the confidence band(s) for the expected growth curve(s)? 
Depending on whether we take p = q = 3 when analyzing the data In Table 17, 
the procedure used to answer questions (I), (2) artd (3) will differ. For Il- 
lustration purposes, we will demonstrate both techniques using a program de- 
veloped at the Educational Testing Service cal led ACOVSM, Joreskog, van ThI I lo 
and Gruvaeus <I97|), 
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SCr 



ANS 



Pal 




" 2 3 .12 \ 5 I 

Figure 6. Mean Plots for Data fn. Table 17 

Assuming that p = q = 3, the matrix B for the data In Table 17 Is 



B = 

,1^20 ^21 ^22 ®20 ^21 ®22 ho h\ , ^22 ^ 

With P defined In (53), B Is estimated by 

. f 115.778 4.(39 tO. 593 63.278-0.472 0.417 23.611 1.333-0.278 

B = . ■ ■ .,, \ 

^ 118.444 5.028 -0.694 62.000 2.556 -0.278 23.6^2 0.456 -0.078 

To test for parallelism 
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f B.. 1 




f \ 

d2| 






^22 




a ' 


62, 


6,2 




^22 






h\ 


- ^12 ' 




. ^22 - 



simultaneously for all variables, the matrices 

f A. 0 

C = (.1 -I) and A.= 



A, 



are. used where 



r 0 0 1 

I 0 
0 I 



0 1 
0 

"■5} 



for 1=1, 2, 3 



0.05 



Wllks' A-crfterJon for the test Is A = 0.583 and_comparJjiig^^ 



0.426 using Wall's table. Wall (1967), the para I lei Ism test Is not rejected. 
The p-value for the test Is ap « 0.3292. 

Given paral lel Ism, we next test, for coincidence. 
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'^20 ' 




Pll 




62 J 




^12 
9 10 




^22 
®20 






s 


^21 




9 ,2 




®22 








^20 










^ h2 . 




^ ^22 - 



again assuming p =» q. For this test, ^ * , 

C (I -f) and A = Iq 

Computfng Wllks' A-crlterlon, A = 0.422. Since tables for the U dlstrfbutlon 
are not available for = ^{9^^ 16)' "^V compute either Rao's multivariate 
F-statlstIc, F = 1.216 with 9 and 8 degrees of freedom or Bari-fett's chl-squared 
statistic, « 9.15 with 9 degrees of freedom; both are approximations of the 
-g ^nAft^t iu^ictrH^ ^ if }r^p f r^r ^y?^fnp|ft , B^n, I973> p. 556 y Timm, 1974). The 

p-va lues for the two criteria are a =» 0.3965 and a « 0.3575 respectively, 

. P .P - 

Indicating that we would not reject the coincidence hypothesis. 

Treating the data In Table 17 as data obtained from a single group, we 
estimate the common re^gresslon function for al l variables simultaneously with ' 

B = (117. Ill 4.583 -0.639' 62.e39 1.041 0.069 23.617 0.894 -0.178)' 

using either a restricted rhultl variate linear model or by pooling all the data 
Into a single group. However, If this equation Is taken as our final regression 
model we may have overfit one or more variables. This commonly occurs In ex- 
periments , with five or more time points. Proceeding we test the hypothesis 
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using the matrfces 





1 A 




' 0 ■ 




H: 






0 










0 

k * 




. \ 


' 0 


0 


0 : 




0 


0 


0 




1 


0 


0 ' 




0 


0 


0 


1 and A « 


0 


0 


0 




0 


1- 


0 




p 


0 


0 




0 


0 


0 




0 


0 


\ 



to see ff the mean trend associated wfth each variable given by the vebtor, 
(121.056 123.722 125. ill 63.75a 65.000 66.389 24.333 24.694 24.\700) 

■ . ■ • \ • 

may be adequately represented using a Ifnear m6de4. Performing the test^ \ 



.0.04 



A « Oe438 and cxxnparing A with j jyj « 0.479 the hypothesis Is rejected. \ 
The p-value for the test is ctp • 0.0052. Had we filled to reject the hyp6- 

tt^esls, models for Zullo's data would have been represented by 

, ' ■ . . <fr ■ ■ ■ . \ ■ ■ ■ ■ • 

^SOr ^ 119.240 + 2.l028t 

y^g « 62.408 + |.3l9t > 



Tal 



V24.2I0 > O.I83t 



If we set the weight matrix 6 « I. Confidence bands for linear equations would 
be obtained by setting. 

C « I. B » {0,Q P,, «l| «id 



1 
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' 0 " 




' 0 




t 




0 




0 




0 




1 




0 


A — 




or A * 




or n — 










t 




0 




0 




0 


• 1 


1 




.0. 




0 

V J 




t 

k 4 



Bands for higher order polynom'als follow similarly. If the growth curves 

were not coincident, we could also find confidence Intervals for the dlffer- 

/ '' 
ence between the ptvo growth curves. /The procedures are N lustrated' by Pott* 

hoff and Roy (1964), KhctrJ (1S»66), and Grizzle a.id AI len (1969). 

Instead of analyzing Zullo's'data with p = q, suppose that we (lecli|^d 

a priori or through a statistical test that the regression model for each 

variable was linear. Then, p < q ant . 



B 



^10 ^11 9|0 ®lf ^10 



^20 ^21 



7 



®20 ®2I 



^20 "^21 



Using the Rao-Khatrl modej, with G = S, we test the coincidence hypo-^ 



"~thesTs 



• 10 



11 



10 



'II 



10' 
'II 



*20 



'21 



'20^ 



'21 



'20 



•21 



by usTng.tlie matrices. 



C' =(l -I) and A » I 



6 

,0.05 



^ For this test, A = 0.440 and comparinq A with U^^g ^ . j. = 0^271 we conclude 

ERIC ' ' ' 
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that* the growth curves for each group are coincident for all variables. The 
p-val.ue for the test^ Is Op » 0.2300. However, with p < q and 6 = S, the 
models fit to each variable take the following form 

Vsor " 121.210 + l.820t 

Yans ^ 63.285 + l.l96t 



'Pal 



= 25.045 - 0.023t 



which, as expected, do not agree with the models arrived at by tdking G = I 
since p < q. 

Comparinq the three regression mddels which may have been obtalhed using 
Zullo's data>'the observed and predicted values for the models are displayed In 

Tab4e 48, ... 

' Table 18. Regression Models 

Predicted Means 



o Observed Means 



121.056 
123.722 
125.11 I 
63.750 . 
^-65-.000 - 
66.389 
24.333 
24.694 
24.700 



Quadratic 
(p = q) 

121.355 
123.721 
125. 109 
63.750 

-—-44^999- 



66.38^ 
24,333 
24.693 
24.6517 



Linear , 
<p < q, G> I) 

121.268 
123.296 
125.324 
62.4f)8 



69.048 
24.210 
'24.393 
24.576 



Linear 
(p < q, G = S) 

121.210 
123.030 
124.850 

63.825 
- — ^tJ5T0£+-- 

66.217 

25.045 

25.022 

24.999 i 

r 



Using WllksV A-crlterlon, we may constriict (I - a) 5i simultaneous confl- 
ddnce bands for each variable and each model./ The general" expressions for 
each band take the form 

a) Potthoff-Roy 



f(t) + 
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with S Y''(I-W(W^W)"'w')Y and Y = Y G"'p' (PG~'p' )"' 



o 



b) Rao-Khatrl 



f(t) + 











+ 






R(f' S f) 






i ^ J 





with S = (PS"'p»)"' 
e 

R = (W'W)"'l+C(W'W)'''wW "BF>3s"'y!W(W»W)" 



for a single group problem where U^' = ^(9^^ 17)^ 0;2392 when p = q or p < q 

an^6 = I and = U^^^^. = 0.27T4 when p < q and G = S for our example. 

Assuming Zul lo*s data InTable 17 was obtained at three expertitiental 
conditions rather than three time points, tests of differences between groups 
(67), differences ambng conditions (69), and Interaction between groups and 
conditions (65) would be of primary Interest for the multivariate observa^^ - 
tlons observed at each condition. Alternatively, qlyen that the Interaqtlon 
hypo-'iiesls !s tenable^ tests of differences between groups arid differences 
-anpna_CQDdllJ^ins,>.--as^ (72)> may be teset^^JjJs lj\g the pro;^ 



gram described In Tl mm and Carlson (1973) to analyze the data In Tat)le 17, 
Wllks* A-crlterlon and multivariate F-tests for the hypotheses are displayed 
In Table J9. . ^ ' , 



/ 
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Table 19. Wu I tl -response Prof fie Analysis of Zullo's Data 



Hypotheses 


Wllks' A 


OF 


Mult-F 


OF 


p-value 




\J • JO J 


<6. 


1. 


16) 


I ^1 1 
t • J 1 1 


( 


6> It) 




A* 


0.422 


(9, 


1. 


16) 


1.216 


( 


9, 8) 


0.3965 


C*> 


0.026 


(6, 


2, 


16) 


9.459 


(12, 22) 


<.000l 


A 


, 0.884 


<3. 


1, 


16) 


0.613 


( 


3, 14^ 


0.6176 


C 


0.034 - 


(6, 


.1. 


16) 


52.437 


( 


6, iir 


<.000l 



As we mentioned previously, mixed model multivariate tests are obtained 
from the appropriately normal I zed multivariate hypotheses In Table 19. To 
see this,. consider the hypothesis and error mean squares and products matrfpes 

for testing C; the matrices were obtained by normalizing the post matrix 

/ ■ ■ 



1 


0 


0 


" 0 


0 


0 


0 


, 1 


0 


' 0 


0 


0 


.1 


^} 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


0 


0 


1 


c 


0 


0 


0 


-1 


-1 


0 


0 


0. 


0 


6 


0 


\ 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


0 


-1 


-1 



fop the hypothesis given In (72) jwheft writing the hypothesis In the form 
C'UA = 0: 
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MSP, 



'^8.028 ^ 

(^96^3j9^ ^-l7.5 2t (62^74 

2.9?7Kt O.53T) 1.904 ,) 

8.708 > 0.^65 0"^^ 



I MSPc = 

I t 





233\-2pjl6 j 0 . 1 83 j*V^0.049p -0 . 634 X^0 ^383). 

/jveragfng the "clriled" diagonal elements of the above matrices, the MSPq and 
I^SPg matrices for the multivariate mlxejij model test of C are obtained: 



76.463 

47.894 3\l.366 
7.373 : 4v280 0.795 



MSP^ = 



f 0.472 ■ ' 
0.273 0.852 
-0.271 -0.164 0.773 



le, degrees of freedom associated with the multivariate mixed model matrices 



I » * V ■ ■ i 

arp Vj^ and v ; obtained from the forTnula 



\J « Vj,-R(A>/p = 1-6/3 = 2 
»-v^-RC'A>/p =16-6/3 = 32 



where p denotes the number of varlbbles, R(A) Is the rank of the post matrix 
A, and vi, and v. are the hypothesis and error degrees of freedom associated 
with Wl/lks' A-crlterlon for tWstlhg C as displayed In Table 18. Wl lks' a- 
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crltprlon for testing C using the multivariate mixed model Is A ® 0.0505 



i 
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b 05 ■ 
which Is compared to iJ^^ 2 32) * or usinq the multivariate F-crlterlon, 

F(6,60) = 30.64, which we compare with P(g^go) " 3.12. The p-value for the 

test Is less than O.OOOJ. 

Analyzing the data a variable at a time using three univariate mixed 

model split-plot designs, the univariate F-ratlos for testing C are Immediately 

obtained from the mujt I varl ate. mixed model analysis. The univariate F-ratlos 

are , 

Variables F-va I ue p*va I ue , 

SOr 76.463/0.472 « 162.1 < -0001 

ANS 31.366/0.852= 36.82 < .0001 

Pal 0.795/0.773= . 1 .03 0.3694 

5. Summary 

.. . . ■ . • . " ■ . 

In this paper we have ghown how multivariate models may be used to 

analyze repeated measures profile and growth curve data when univariate or 
multivariate mixed model assumptions are not tenable. This should not be 
taken to mean that a multivariate approach to the analysis of such designs 
shouM always be used or that It Is always most appropriate. If the restrrc- 
tlve mixed model assumptions are tenable for a data set, we would always use 
the simplest model to analyze the data. For thi^ reason, we have shown how 
one ray recover standard mixed model tests from certain multivariate hypo- 
theses. Procedures for testing whether^^ model assumptions are tenable 
are discussed In TImm (1974). 
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